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ABSTRACT 


j?ixed  configuration  feedback  control  often  forms  the 
basis  for  the  design  of  a  linear  control  system.   The 
design  freedom  is  limited  to  the  adjustment  of  the  free 
parameters  of  the  system.   Analytical  methods  prove  to  be 
valuable  in  these  circumstances  and  the  aim  is  the  optimi- 
zation of  a  selected  index  of  performance.   A  suggested 
index  is  developed  for  a  regulator  system  from  a  comparison 
of  the  dynamics  of  the  subject  system  witn  those  of  a 
desired  model  along  a  transient  state  space  trajectory. 
The  result  is  an  optimal  system  dependent  on  the  initial 
state  chosen  for  the  transient  response.   The  effects  of 
the  initial  state  on  the  optimal  system  are  investigated 
and  the  final  selection  is  based  on  statistical  consider- 
ations. 


TABLE  OF  CONTENTS 

CHAPTER  PAGE 

I.    INTRODUCTION  7 

II.    THE  INDEX  OF  PERFORMANCE 12 

Structure  and  Development  12 

A  Time-varying  Optimization  Method   ...  20 
III.    THE  OPTIMUM  SYSTEM  AS  A  FUNCTION  OF  THE 

INITIAL  STATE  25 

Second  Order  System   26 

Third  Order  System 35 

IV.    EVALUATION  OF  RESULTS 48 

BIBLIOGRAPHY  51 


LIST  OF  ILLUSTRATIONS 
FIGURE  PAGE 

1.  Signal  Flow  Graphs  for  Model  and  Actual 

Systems 15 

2.  A  Typical  Second  Order  System  15 

3.  Phase  plane  Trajectory  for  System  of 

Figure  2 17 

*K   Signal  Flow  Graph  showing  the  Structure 

of  the  Index 17 

5.  A  Plot  of  k(x)  -vs  -  t;  Model:  y  +  2.8y  + 

l±y   =  0;  Actual  System:  x  +  x  +  kx  =  0; 

xT(0)  =(10) 23 

6.  A.  Constrained  Second  Order  System 29 

7.  (a)  Initial  Conditions  plane,  (b)  Root 

2 
Locus  for  s  -j-s-Hk  =0   . 29 

8.  Minimum  Cost  versus  Initial  Conditions   ...    31 

9.  Cost  as  a  Function  of  the  Initial  State 

for  Different  Optimum  Settings  of  the 

Free  Parameter 31 

10.  Total  Cost  as  a  Function  of  the  Free 

Parameter 3^ 

11.  Size  of  Optimum  Regions  for  Several  Models.  .    3^ 

12.  Isometric  projection  of  Cost  Surface  for  a 

2 

Model  Characteristic  Equation  s  +2.8s+4  =  0 

and  an  Initial  State  Vector  xT(0)  =(10).     36 


FIGURE  PAGE 

13*   Isometric  projection  of  Cost  Surface  for  a 

2 

Model  Characteristic  Equation  s  +2.8s+4 

T 
=  0  and  an  Initial  State  Vector  x  (0)  = 

(0.866  0.5) 37 

14-.   Isometric  projection  of  Cost  Subsurface 

for  a  Model  Characteristic  Equation  s^+ 

2 
7.8s  +l8s+20  =  0  and  an  Actual  System 

with  a  Constraint  a  =  2.   The  Initial 

State  Vector  is  xT(0)  =  (-0.  754-, 0. 133, 

0.64-3) 4-0 

15.  Optimum  pole  Regions  for  Third  Order  System 

with  Constraint  in  a^  =  2 4-1 

16.  Isometric  Projection  of  Cost  Subsurface. 

Model  and  Actual  System  as  in  Figure  14-. 

Initial  State  Vector  xT(0)  =(100)...     44 

17.  Mapping  of  the  Unit  Circle  on  the  x^-x 

Plane  onto  the  s-plane  ..........     4-5 

18.  Optimum  pole  Regions  for  Third  Order 

System  with  Constraint  in  a,  =  6 4-7 


CHAPTER  I 
INTRODUCTION 

The  design  of  feedback  control  systems  sometimes  in- 
volves the  selection  of  free  parameters  in  the  plant  and/or 
compensator  in  order  to  satisfy  the  requirements  of  the  per- 
formance specifications.   The  configuration  of  the  system  is 
assumed  to  be  fixed,  i.e.,  a  compensator  nas  already  been 
chosen  and  the  design  freedom  is  limited  to  the  adjustment 
of  cue   or  more  parameters.   The  trial  and  error  process  for 
the  selection  of  several  parameters  represents  a  very  labor- 
ious and  sometimes  impossible  task  for  the  classical  design 
by  root  locus  methods.   Analytical  methods  are  appropriate 
in  this  case.   A  measure  of  quality  is  established  for  the 
system  in  question  by  the  construction  of  an  index  of  per- 
formance, xuhich  upon  minimization  (or  maximization)  will 
yield  the  optimum  values  for  the  free  parameters  of  the 
system. 

Different  criteria  could  be  adopted  for  the  construc- 
tion of  the  index  of  performance,  all  normally  based  on 
physical  reasons  and  eacn  satisfying  particular  requirements. 
Many  performance  indices  originating  from  good  engineering 
reasoning  lead  to  analytically  insolvable  problems.   A  com- 
promise in  the  selection  of  the  index  is  then  necessary  to 
obtain  a  solution.   The  classical  forms  of  the  performance 
specifications,  such  as  rise  time,  maximum  overshoot, 
settling  time,  etc.,  in  the  time  domain  or  bandwidth,  phase 
and  gain  margins,  etc.,  in  the  frequency  domain,  are  trans- 
formed into  a  single  measure  by  conceiving  an  ideal  model 

? 


whose  behavior  meets  all  the  performance  specifications.   A 
mathematical  relationship  established  between  some  variables 
of  this  model  and  the  corresponding  variables  in  the  actual 
system  serves  as  a  measure  of  quality  as  the  free  parameters 
are  changed  in  a  search  for  the  optimum  adjustment.   The 
time  integral  of  the  difference-squared  between  the  output 
of  the  model  and  the  output  of  an  actual  system  is  a  practi- 
cal index  of  performance  when  the  system  is  subjected  to 
transient  input  signals.   Here  the  model  has  a  transfer 
function  equal  to  unity.   This  is  usually  solved  with  the 
aid  of  Parseval's  Theorem1-  <-». 

An  index  of  performance  has  been  derived  for  the  regu- 
lator problem!-!  J.  This  index  of  performance,  or  cost  func- 
tion, is  a  quadratic  function  of  the  state  vector, 


J  -   /Vqs 


X  dt  (1) 


The  matrix  of  the  quadratic  form,  Q,  is  the  weighting 
matrix  and  contains  the  free  and  fixed  parameters  of  the 
actual  system  and  some  weighting  factors  determined  by  the 
model  or  ideal  system.   The  model  obtained  from  the  per- 
formance specifications  is  of  the  same  order  as  the  actual 
system.   The  weighting  factors  are  adjusted  in  such  a  way 
that  if  all  the  parameters  of  the  actual  system  were  free, 
the  cost  function  would  exhibit  an  absolute  minimum  at  the 
model  values.   If  the  actual  system  is  constrained  to  have 
less  than  n  independent  free  parameters,  a  minimization  of 
the  cost  function  will  yield  the  optimum  values  for  these 
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parameters. 

The  measure  of  quality  is  obtained  by  disturbing,  tne 
system  with  some  initial  conditions.   j?or  a  stable  system, 
the  state  space  trajectory  ends  up  at  the  origin  for  large 
values  of  time.   This  type  of  excitation  is  characteristic 
of  the  regulator  problem.   By  minimizing  this  cost  function 
the  trajectory  of  the  subject  system  is  forced  to  approximate 
as  closely  as  possible  the  trajectory  of  the  model.   If  all 
n  parameters  of  the  system  were  free,  it  would  indeed  simu- 
late identically  the  dynamics  of  the  model  and  hence  satisfy 
in  full  agreement  the  performance  specifications.   In  any 
other  case,  the  model  behavior  will  not  be  reproduced,  but 
the  actual  system  will  attain  its  best  performance  as 
measured  by  this  optimization  criterion. 

The  importance  of  this  method  over  the  common  types 
of  indices  is  the  consideration  given  to  every  part  of  the 
dynamics  of  the  system  and  not  to  a  single  manifestation  as, 
for  example,  the  error  in  position.   The  contributions  from 
all  the  state  variables  are  properly  weighted  according  to 
the  characteristics  of  the  model,  which  carries  the  infor- 
mation of  the  performance  specifications. 

The  evaluation  of  the  integral   in  equation  (1)  is  done 
by  Liapunov  functions  with  vector-matrix  methods,  and  the 
final  form  is  shown  to  be  a  quadratic  function  of  the 
initial  state, 

J  =  xT(0)Px(0)  (2) 

The  matrix  of  this  quadratic  form,  P,  is  related  to  the 


weighting  matrix  and.  the  actual  system's  matrix. 

The  nature  of  this  solution  implies  that  the  cost 
function  will  be  different  for  different  initial  states  and 
hence  the  optimum  system  will  depend  on  the  initial  condi- 
tions chosen  for  the  calculation. 

In  this  paper,  a  similar  index  of  performance  is  de- 
veloped, based  upon  a  different  approach  than  that  described 
above.   To  obtain  a  measure  of  performance,  at  every  point 
on  the  state  space  trajectory  of  the  actual  system,  a  com- 
parison is  made  between  the  dynamics  of  this  system  and  the 
dynamics  the  model  would  have  if  it  were  at  that  particular 
point. 

The  index  of  performance  can  be  expressed  in  the  same 
form  as  equation  (1)  and  hence  is  also  a  function  of  the 
initial  state.   However,  the  weighting  matrix  is  now  direct- 
ly obtained  from  the  coefficients  of  the  model  and  actual 
system  characteristic  equations.   This  is  a  much  more  direct 
method  than  that  for  obtaining  the  Q  matrix  in  equation  (1), 
which  relies  on  complicated  algorithms  for  the  weighting 
factors.   In  the  analysis  of  this  index  it  is  found  that 
the  results  are  exactly  the  same  as  for  the  index  of  equation 
(1).   Further  investigation  shows  that  both  cost  functions 
are  intimately  related  by  a  constant  factor  and  an  additive 
constant.   The  effects  on  the  optimum  system  of  the  initial 
state  chosen  for  the  calculation  are  investigated  in  this 
paper  and  the  final  decision  on  the  design  is  based  on  the 
statistical  characteristics  of  the  disturbing  initial  con- 
ditions. 
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The  new  concept  developed  also  suggests  a  time-varying 
optimization  scheme  by  which  the  actual  system  would  be  made 
to  follow  exactly  the  state  space  trajectory  of  the  model  by 
continuously  varying  its  free  parameters  so  as  to  match  at 
every  point  the  dynamics  of  both  systems.   Examples  are  pre- 
sented to  complement  the  theory. 
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CHAPTER  II 
THE  INDEX  OP  PERFORMANCE 

The  first  step  in  the  process  of  analytical  design  is 
to  establish  the  concept  on  which  the  index  of  performance 
will  be  based.   The  objective  of  this  performance  index  is 
to  include  in  a  single  number  a  measure  of  quality  for  the 
performance  of  the  system.   Factors  such  as  mathematical 
difficulties  will  perhaps  force  the  designer  to  modify  his 
performance  index  in  favor  of  mathematical  simplicity,  hope- 
fully keeping  the  essence  of  the  idea  that  originally  moti- 
vated it.   Once  the  configuration  of  the  system  is,  fixed  and 
the  index  of  performance  has  been  defined,  the  design 
proceeds  in  a  straightforward  manner.   For  the  type  of  index 
to  be  considered  here,  the  performance  specifications  are 
transformed  into  an  ideal  or  model  system  thus  fixing  the 
location  on  the  s-plane  of  the  required  zeros  and  poles  of 
the  transfer  function.   This  model  is  of  the  same  order  as 
the  actual  system  and  fully  satisfies  the  specifications. 
The  model  and  actual  systems  can  be  represented  by  the  signal 
flow  graphs  shown  in  Figure  1. 

The  feedback  coefficients  of  the  model  are  defined  by 
the  performance  specifications.   Some  of  the  coefficients 
of  the  actual  system  are  constrained  by  the  physical  nature 
of  the  plant,  and  the  others  are  functions  of  the  free  para- 
meters,  If  all  coefficients  in  the  actual  system  were  free 
it  would  be  trivial  to  reproduce  the  model.   Generally  this 
is  not  the  case  and  the  free  parameters  must  be  adjusted 
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according  to  some  crlterione 

A  measure  of  quality  which  originates  from  a  good 
physical  concept  is  given  by 


J-fl$r-&f* 


where  the  integrand  is  the  square  of  the  difference  between 
the  n   derivatives  of  the  model  and  actual  systems  differ- 
ential equations  respectively,  when  the  system  is  excited  by 
initial  conditions  only.   This  index  gives  a  comparison  of 
the  complete  dynamics  of  both  systems  in  terms  of  the  high- 
est derivatives,  and  does  not  require  any  weighting  factors 
since  it  implies  a  direct  relationship  between  the  two 
systems.   The  minimization  of  equation  (3)  as  function  of 
the  free  parameters  results  in  an  actual  system  whose  dynamic 
behavior  is  a  close  approximation  to  that  of  the  model, 
however,  the  development  of  this  performance  index  into  a 
practical  form  presents  the  impediment  of  requiring  the 
solution  of  both  system  differential  equations,  which  shadows 
the  merit  of  its  physical  meaning  and  renders  the  integra- 
tion of  equation  (3)  very  difficult.   It  is  then  necessary 
to  conceive  a  similar  structure  for  the  index  of  performance 
but  one  which  permits  convenient  mathematical  manipulations , 

A  similar  way  of  evaluating  the  performance  of  the 
system  can  be  obtained  from  a  comparison  along  a  trajectory, 
of  the  nth  derivative  of  the  actual  system  differential 
equation  with  that  of  the  model  when  both  systems  are  in  the 
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same  state.   It  is  again  assumed  that  the  system  is  driven 
by  initial  conditions  only.   The  motivation  for  this  index 
arises  from  a  consideration  of  a  second  order  process.   Con- 
sider the  system  shown  in  Figure  2.   The  system  differential 
equation  is 

x  -t-  a~x  +  a-^x  =0  (4.) 

where  a-i  is  the  free  parameter 

The  performance  specifications  require  a  model  system  char- 
acterized by  the  differential  equation 

y  +  g2y  +  &iy  =  0  (5) 

The  actual  system  trajectory  in  the  phase  plane  is  shown  in 
Figure  3.   At  any  point  on  this  path,  x  is  determined  by  the 
coordinates  of  the  phase  plane  and  the  coefficients  of  the 
differential  equation 

\   "  "a2*l  "alxl  (6) 

Also,  equation  (5)  determines  the  value  of  y  at  any  point  on 
the  phase  plane 

where  the  subscript  1  indicates  the  particular  value  of  the 
variables  at  any  given  point. 

Along  any  trajectory  of  the  actual  system  there  will  be 
a  continuous  function  of  the  state  giving  the  value  of  y. 
This  function  is 
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model 


actual  system 


Fig,  1 .   Signal  flow  graphs  for  model  and  actual  system 


X 


Fig.  2.   A  typical  second  order  system 


1-5 


y  =  -  £2*  -  SjX  (8) 

The  optimization  criterion  is  the  minimization  of  the  differ- 
ence squared  between  the  variables  x  and  y  along  the  actual 
system  trajectory.   The  index  of  performance  becomes 

J  =  /  [x-Mfclt  (9) 


-/rs-S 


when  actual  system  and  model  are  in  the  same  state.  Then 

Figure  k   shows  a  signal  flow  graph  for  the  calculation  of 
the  index. 

In  searching  for  the  optimum  adjustment  of  a1 ,  the 
trajectory  along  which  this  comparison  is  made  will  change 
until  the  value  of  the  index  is  a  minimum.   This  will  be  the 
closest  trajectory  to  that  of  the  model  and  the  performance 
of  the  actual  system  will  have  been  optimized  according  to 
this  criterion.   In  terms  of  the  dynamics  of  motion,  we 
wish  to  make  the  acceleration  of  the  actual  system  at  any 
point  on  the  phase  plane  a  best  approximation  to  the  accel^- 

eration  the  ideal  system  would  have  at  that  point. 

th 
This  idea  is  extended  to  an  n   order  system 
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I   i 


[x(0),x(0)] 


Pig.  3.   Phase  plane  trajectory  for  system  of  Fig.  2 


z 


■1 


Fig.  4.  Signal  flow  graph  showing  the  structure  of 
the  index 
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where  the  index  of  performance  becomes 

ad 


J   = 


d  tn  di71 


it 


when  actual  system  and  model  are  in  the  same  state. 


(12) 

Then 


+  *:a*)#  t  c?i-^) 


'ctt 


By  defining  the  state  vector 


(13) 


x  = 


X 

c/oc 


(1*0 


this  index  can  be  written  in  quadratic  form 


+  •  •  •  +  l%'^)^h"  H)  x*xi 


c£* 


[xx   *Z  XJ 


b^     bi5L 


>r\1    -  - 

where   bjj    =    (s^    -   a.)    (gj        a J »    1  -   1»2> 
n. 


'in 


Till. 


(15) 


(16) 


n  and   j   =  1 , 2 , 
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Then 


/CO 
xbxdt 


(17) 


where  the  matrix  of  the  quadratic  form,  B,  is  a  positive 
semi-definite,  symmetric  matrix. 

This  is  the  general  form  of  the  index  of  performance 
as  given  in  Equation  (1).   It  is  solved  by  vector-matrix 
methods  using  Liapunov's  Theorem!1 J.   The  solution  is 


J  =  x  (0)  P  x(0) 


(IB) 


where  p  is  the  matrix  of  the  Liapunov  function  and  is  re- 
lated to  the  weighting  matrix  B  and  the  actual  system  matrix, 
V  by 


-B  =  A0  P  +  PA 
a       a 


(19) 


The  B  matrix  is  directly  obtained  from  the  model  and 
actual  system  coefficients  as  shown  in  equation  (16).   The 
actual  system  matrix  is  defined  by  the  matrix  differential 
equation  in  canonical  phase  variable  form 


*  =  Aa  * 


(20) 


where 


\  = 


0X0 

0  o   1 


-a,  -ci. 


0 


.  1 


(21) 
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Signal  flow  graphs  are  helpful  in  solving  equation 
(19)  for  the  elements  of  the  p  inatrixL^J.   The  results  for  a 
second  order  system  are  stated  here  for  illustration. 

r,  =  -b«- +  js,  " +  i£Z b" +  isi6** 

^  -  2^  b"    =  ^  (22) 

ft*  ^Zli  V  +  ^  bM 

The  cost  function,  equation  (18)  becomes 


J  =  x21(0)p1]  +  2Xl(0)x2(0)p12  +  x22(0)p22   (23) 

The  minimization  of  the  cost  function  will  yield  the 
optimum  adjustment  for  the  free  parameters.   Because  of  the 
nature  of  this  artifice,  the  optimum  system  will  depend  on 
the  initial  state  chosen  for  the  calculation.   This  problem 
is  discussed  in  Chapter  III. 

A  TIME- VARYING  OPTIMIZATION  METHOD 

The  minimization  of  the  index  of  performance  developed 
in  the  last  section  produces  a  set  of  parameters  for  which 
the  dynamics  of  the  system  is  a  best  approximation  to  that 
of  the  model.   In  terms  of  the  state  space,  this  means  that 
the  actual  system  trajectory  is  now  the  closest  trajectory 
to  that  of  the  model  which  can  be  achieved  with  this  con- 
strained system  under  the  effect  of  a  given  set  of  initial 
conditions.   The  index  is  now  a  measure  of  the  total  error 
incurred  by  the  system  in  going  from  this  particular  initial 
state  to  the  origin  of  the  state  space.   Because  it  is  a 
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quadratic  function,  it  gives  more  importance  to  large  errors 
than  to  small  errors  but  is  not  capable  of  reducing  the  mag- 
nitude of  any  particular  error  in  performance. 

The  criterion  on  which  this  index  is  based  suggests  a 
possible  way  to  obtain  with  the  actual  system  an  exact  re- 
production of  the  model  dynamics  if  the  free  parameters  are 
allowed  to  vary  continuously  according  to  some  function  of 

the  present  state.   Actually,  it  would  be  enough  to  have 

th 
only  one  free  parameter  in  an  n   order  system  to  implement 

this  scheme. 

Consider  again  the  second  order  system  of  Figure  2. 

The  actual  system  and  model  differential  equations  are  given 

in  equations  (^)  and  (5)  respectively.  rfhen   both  systems  are 

in  the  same  state. 

y  =  x 

*      • 

y  =  x 

and  the  condition  for  the  two  state  space  trajectories  to 
be  the  same  (and  so  the  dynamics  of  both  systems)  is 

y  =  x 

or 


g  x  +  g2x  =  ax  +  a2x 


then 


ax  =  g.  +  (&2"a2)  T  <2^ 
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Equation  (24)  is  the  required  functional  relation  be- 
tween the  free  parameter  and  the  state  of  the  system.   This 
is  plotted  in  Figure  5  for  a  typical  case. 

The  curve  shows  a  discontinuity  whenever  the  trajec- 
tory crosses  the  x-axis  in  the  phase  plane.   Since  infinite 
gain  is  not  practically  f easable ,  the  function  can  be  approx- 
imated as  shown  in  Figure  5«   A  change  in  the  sign  of  the 
gain  factor  from  time  to  time  is  also  required.   The  reason 
for  the  discontinuities  is  that  when  x  =  0,  the  free  param- 
eter, a  ,  which  modifies  the  variable  x  in  the  feedback  path, 
has  no  effect  on  the  behavior  of  the  system,  now  solely  con- 
trolled by  the  variable  x  and  its  fixed  feedback  parameter 
a?.   Thus,  an  infinite  gain  is  the  result  of  the  impossi- 
bility of  altering  the  system's  trajectory. 

th 
For  the  general  case  of  an  n   order  system,  the  con- 
dition under  which  the  actual  system  will  duplicate  the 
model  dynamics  is 

£x  +&  if  +  '  •  •  +  fr^   - 


dt 


n-1 


If  we  assume  that  a.  is  the  only  one  free  parameter,  then 

**  =  ^  y*-*«>-*P- * —  *t&-o,)    ff-        (26) 

Equation  (26)  shows  that  only  one  free  parameter  is 
needed  to  reproduce  the  model  dynamics  if  the  state  of  the 
system  is  known.   Normally  the  fact  that  the  state  vector 
is  completely  measurable  implies  that  the  feedback  paths 
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t,  sec 


Pig.  5.   A  plot  of  k(x)  versus  t;  model:  y  +  2.8y  +  4y  =  0 
actual  system:  x  +  x  +  kx  =  0  and  xT(0)  =  (1   0) 
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can  be  modified  bo  copy  the  model  characteristics  exactly. 
This  discussion  would  apply  in  those  special   cases  in  whj 
the  state  vector  is  measurable  but  cannot  be  used  directly 
in  the  feedback  channel. 
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-  CHAPTER  III 
THE  OPTIMUM  SYSTEM  AS  A  FUNCTION  OF  THE  INITIAL  STATE 

The  index  of  performance  that  will  yield  the  optimum 
system  is  a  function  of  the  initial  state.   vVe  wish  to  in- 
vestigate the  effect  of  the  initial  conditions  on  the 
optimum  pole  locations.   These  optimum  poles  will  occupy 
certain  regions  on  the  s-plane  according  to  the  constraints 
of  the  system  and  the  requirements  for  stability.   Also  of 
interest  is  the  knowledge  of  how  the  extension  and  shape  of 
these  regions  vary  as  a  function  of  the  relative  position 
of  the  model  poles  with  respect  to  the  actual  system's 
attainable  root  regions. 

Only  the  normalized  initial  state  vector  will  be  con- 
sidered in  this  discussion  since  all  other  points  in  the 
state  space  are  proportional  to  this  unit  vector  and  differ 
in  cost  function  only  by  a  constant  factor.   For  each 
orientation  of  the  unit  initial  state  vector  there  is  a 
corresponding  optimum  set  of  poles  for  the  actual  system 
and  a  value  of  the  cost  function  which  is  a  minimum  for 
this  particular  choice  of  initial  conditions.   Any  other 
orientation  will  yield  a  different  set  of  optimum  poles. 
However,  it  will  be  seen  that,  because  of  the  symmetry 
exhibited  by  the  index  of  performance,  only  a  half  of  the 
state  space  need  to  be  searched  for  optimization.   The 
design  must  provide  a  system  whose  performance  is  optimum 
in  some  modified  sense  for  all  possible  initial  conditions. 

The  selection  of  such  a  set  of  optimum  parameters  must 
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be  done  on  the  basis  of  the  statistical  properties  of  the 
disturbance.   If  the  probability  density  function  can  be 
established,  then  the  average  value  of  the  cost  incurred  by 
the  system  can  be  found  for  all  sets  of  optimum  parameters. 
The  set  that  provides  the  minimum  average  cost  is  the 
design  selection.   This,  of  course,  implies  the  consider- 
ation of  the  behavior  of  the  control  system  as  a  regulator. 
It  is  not  possible  to  obtain  an  analytical  relationship  for 
the  optimum  poles  as  a  function  of  the  initial  state  and 
the  proximity  of  the  desired  model  poles  for  a  given  con- 
strained actual  system.   However,  the  general  trend  is  that 
the  regions  containing  the  optimum  poles  reduce,  and  finally 
collapse  to  a  point,  when  the  model  poles  get  closer  to  and 
reach  the  permissible  regions  for  the  actual  system.  Simi- 
larly, the  same  effect  is  obtained  by  gradually  releasing 
the  constraints  of  the  actual  system  but  keeping  the  same 
characteristics  of  the  desired  model.   These  effects  will 
be  discussed  for  the  second  and  third  order  systems  by 
means  of  examples. 

SECOND  ORDER  SYSTEM 

The  results  of  the  optimization  scheme  developed  in 
Chapter  II  will  now  be  discussed  for  a  typical  second  order 
system.   Two  parameters  define  the  dynamics  of  this  system. 
The  method  is  applicable  when  one  of  this  parameters, 
usually  in  the  plant,  is  fixed.   With  only  one  degree  of 
freedom,  the  possible  poles  for  this  system  must  lie  on  a 
definite  locus.   A  pair  of  required  poles  outside  this  locus 
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is  simply  unattainable  and  the  optimization  process  must 
be  employed. 

Consider  the  second  order  system  shown  in  Figure  6. 
The  transfer  function  is 


•  G  _  -   k 
H   s2  +  s  +  k 


(2?) 


The  free  parameter  is  the  gain  of  the  system  whereas  tne 
plant  contains  the  fixed  parameter.   The  performance 
specifications  require  a  model  defined  by  the  transfer 
function 


C         4 

R  "  s2  +  2.8s  *  k 


(28) 


It  is  noted  that  the  model  poles  are  unattainable  by 
the  actual  system.   It  is  then  necessary  to  find  an  adjust- 
ment for  k  that  will  give  the  best  performance  with  respect 
to  the  model  according  to  the  criterion  previously  establish- 
ed. 

The  cost  function  is  given  by  equation  (23) 

J  =  x12(0)pu  +  2x1(0)x2(0)p12  +  X22(0)P22    (23) 


The  elements  of  the  p  matrix  are  those  given  in  equation 
(22).   The  weighting  matrix  from  equation  (16)  is 


B  = 


(k-4)    (k-*0(l-2.8) 


(l-2.8)(k-^)   (1-2.8)' 


(29) 
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then,  J  becomes 

J  =  x12(0)(0.5k2-0.08k-3.2-h|)  +  2Xj  (0)x2(0)(0.5k-it.+|)  + 

x22(0)(0.5k-2.38+|)  (30) 


Only  points  on  a  unit  circle  in  the  initial  condition 
plane  need  be  investigated.   Equation  (23)  is  symmetric  with 
respect  to  a  diameter  on  the  initial  condition  unit  circle. 
As  a  further  simplification,  only  the  upper  semicircle  will 
be  considered. 

The  root  locus  for  this  system  is  shown  in  Figure  7. 
For  each  value  of  0,  where  G  is  the  orientation  angle  of  the 
state  vector  around  the  upper  unit  semicircle  of  the  initial 
conditions  plane,  Figure  7(a),  a  value  of  k   .  is  found  by 
minimizing  the  cost  function  with  respect  to  this  parameter. 
The  plot  of  optimum  regions  for  the  corresponding  poles  of 
the  actual  system  is  shown  in  Figure  7(b)  together  with  the 
desired  model  poles.   The  extremes  are  located  at  (-0.5+ 
j 1.936)  and  (-0. 5+ jO. 775 )  for  the  upper  half  of  the  s-plane. 
Each  pair  of  conjugate  poles  on  this  region  will  give  an 
optimum  performance  only  when  the  system  is  excited  by  the 
initial  conditions  that  yielded  that  pair  of  poles.   For 
any  other  initial  state  there  will  be  a  different  set  of 
optimum  poles  and  a  correspondingly  different  setting  of 
the  free  parameter  for  optimum  response.   It  is  not  possible, 
of  course,  to  modify  the  adjustment  of  the  free  parameter 
according  to  the  type  of  disturbance  or  even  worse,  to  pre- 
dict its  values.   It  is  then  required  to  adopt  a  single 
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for  s2  +  s  +  k  =  0 
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value  for  the  free  parameter  that  will  give  the  best  average 
index  for  all  possible  situations.   Figure  8  shows  the  value 
of  the  minimum  cost  as  a  function  of  initial  conditions. 
The  horizontal  axis  represents  the  orientation  of  the  initial 
state  vector.   This  curve  shows  that  a  vector  orientation 
of  140°  will  give  an  absolute  minimum  for  the  cost  function 
of  this  example.   This  corresponds  to  kopt  =  O.85  and  the 
optimum  pole  lies  right  at  the  bottom  of  the  allowable 
region.   This  would  seem  the  best  adjustment  to  use  in  the 
actual  system.   Figure  9  shows  the  cost  incurred  by  the 
system  as  a  function  of  the  initial  state  for  different 
optimum  settings  of  the  free  parameter.   It  is  seen  that 
the  optimum  parameter  obtained  at  the  absolute  minimum  of 
the  cost  function  of  Figure  8  yields  the  highest  index 
when  used  with  all  initial  conditions.   The  area  under 
each  curve  is  a  measure  of  the  cost  accumulated  by  the 
system  when  excited  by  all  initial  conditions  on  the  upper 
semicircle  of  Figure  7(a)  for  a  given  optimum  adjustment 
of  the  free  parameter.   Figure  10  shows  a  plot  of  the 
total  cost  as  a  function  of  the  free  parameter. 

The  curve  in  Figure  8  also  exhibits  another  local 
minimum,  which  for  some  models  is  the  absolute  minimum  of 
the  cost  function.   The  corresponding  optimum  parameter 
also  produces  a  high  average  index  as  shown  in  Figure  9. 
The  minimum  area  is  obtained  for  a  k   t  =  2.39>  which 
corresponds  to  an  initial  state  vector  orientation  of  25  . 
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Fig.  ti.   Minimum  cost  versus  initial  conditions 
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Fig.  9.  Cost  as  a  function  of  the  initial  state  for  diffe- 
rent optimum  settings  of  the  free  parameters 
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This  particular  value  of  k  would  be  the  design  selection 
when  there  exists  a  uniform  probability  on  the  initial 
state 

p(G)  =  1  dO  ,         0°*  0  ^180° 

TT 

For  any  given  probability  distribution  on  the  initial 
state,  p(0),  we  define  a  modified  index  of  performance, 
which  will  be  independent  of  the  initial  conditions, 

Jmod  -  /  p(q)  J(e,k)  d0  (3D 

The  minimization  of  this  index  with  respect  to  the  free 
parameter  yields  an  adjustment  for  which  the  average  cost 
of  the  system  is  a  minimum.   As  a  consequence,  the  maximum 
value  of  the  cost  for  any  possible  initial  state  will  also 
have  been  minimized.   This  is  equivalent  to  a  minimax 
solution  in  optimal  control  theoryL-'J. 

For  the  case  of  the  uniform  probability  considered 
above,  the  modified  index  is 

Jo 

=  i  ( p..  +■  ffe) 


(32) 


The  minimization  of  equation  (32)  with  respect  to  k  yields 
the  result  previously  obtained. 

The  size  of  the  optimum  region  depends  on  the  prox- 
imity of  the  model  poles  to  the  root  locus  of  the  actual 
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system.   Figure  11  shows  how  these  regions  increase  as  the 
model  poles  get  further  apart  from  the  root  locus  of  the 
actual  system. 

Only  the  upper  half  of  the  s-plane  is  shown.   For 
model  poles  on  the  root  locus  of  the  actual  system  the 
regions  are  simply  reduced  to  a  point.   The  growth  of  the 
regions  as  the  model  poles  get  further  apart  from  the  actual 
system  root  locus  is  more  accentuated  in  the  positive  jto 
direction,  an  indication  of  the  tendency  of  the  index  to 
make  the  natural  frequency , oj^  ,  of  the  actual  system  equal 
to  that  of  the  model.   The  effect  of  the  value  of  the 
imaginary  part  of  the  model  poles  on  the  size  of  the 
region  is  not  pronounced,  except  that  for  small  values 
of co  ,  some  optimum  poles  could  lie  on  the  real  axis.   Only 
near  model  poles  are  of  interest  nere  since  remote  poles 
would  probably  require  a  change  in  the  configuration  of 
the  actual  system,  which  is  outside  the  scope  of  this 
discussion. 

The  results  stated  so  far  are  all  based  on  the  minimi- 
zation of  a  performance  index  which  is  a  function  of  the 
free  parameter  for  a  given  set  of  initial  conditions  and 
can  be  represented  by  a  two-dimensional  curve.   This  curve 
is  actually  the  intersection  of  a  plane  and  a  more  general 
cost  surface  obtained  when  both  parameters  in  the  actual 
system  are  freeL  -'.   If  in  equation  (23)  the  actual  system 
parameters  are  variable  the  cost  function  becomes 
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2.  .    «3 


+    21.(0)1,(0)  KxZ  S    + 
1    *     2a, 


xf(o) 


2a,  a,^ 


(33) 


The  shape  of  this  cost  surface  will  depend  on  the 
initial  state  used,  as  shown  in  equation  (33)  but  the  mini- 
mum value  of  this  cost  will  always  be  zero  and  lie  on  the 
point  (4,2.8),  which  corresponds  to  the  model  of  this 
example.   The  cost  surface  is  shown  in  Figures  12  and  13 
for  two  different  values  of  the  initial  state  vector  orien- 
tation.  It  can  be  seen  that  while  the  absolute  minimum  of 
the  surface  is  fixed,  the  local  minimum  of  the  inter- 
ception of  the  plane  a  =  1  with  these  surfaces  changes 
with  initial  conditions. 

THIRD  ORDER  SYSTEM 

Consider  a  third  order  linear  control  process  charac- 
terized by  the  differential  equation 

x  +  2x  +  a  x  +  a„x  =  0  (3^) 

2     1 

where  the  coefficient  a  is  constrained  by  the  plant  param- 
eters to  a  value  of  2.   The  specifications  suggest  a  model 
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given  by 


7   +  ?-Qy   +  I8y  +  20y  =  0 


(35) 


Because  of  the  constraint  in  the  actual  system,  these 
characteristics  cannot  be  duplicated.   The  free  parameters 
have  to  be  adjusted  to  obtain  the  optimum  performance.   The 
cost  function  from  equation  (18)  is 


J  =  x1  (0)pn  +  2x3  (0)x2(0)p12  +  2x1(0)x  (0)px   + 

x22(0)p22  +  2x2(0)x3(0)p   +  x32(0)p       (36) 


where  p. *    is  a  particular  element  of  the  matrix  p  obtained 
from  equation  (19)L"~.   The  weighting  matrix  is  now 


B  = 


^-20)' 


(a2-l8)(a1-20) 
(2-7.8)(a1-20) 


(a  -20)(a2-l8) 

(a2-l8)2 
(2-?.8)(a2-l8) 


(ar20)(2-7.8) 
(a2-l8) (2-7.8) 

(2-7. 8)2 


(37) 


The   cost   function  is   then 


J  =    x. 
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where  D  =  a- 

The  effects  oi  the  initial  state  0.1   the  optimum  pole 
location  should  be  investigated  for  all  points  on  the  unit 
sphere  in  the  state  space.   Because  of  the  symmetry  of 
equation  (36)  with  respect  to  a  diameter,  only  a  hemisphere 
need,  be  considered*   For  two  degrees  of  freedom,  the  cost 
function  corresponds  to  a  three-dimensional  cost  surface. 
The  shape  of  this  subsurface  will  change  with  initial  state 
and  i"cs  corresponding  minimum  point  will  move  around  on  the 
a1~a2  plane..   The  subsurface  corresponding  to  a  coefficient 
3.-z  -   7*8  '-ill  b.ave  •  a  minimum  value  of  zero  at  the  model 
values,  independently  of  the  initial  state*   A  typical  sab- 
surface  is  shown  in  Figure  14  for  the  case  x™{j03  =  (-0.754 
0.133  0.543).   By  computer  searching  techniques  the  optimum 
coefficients  for  this  system  <rere  found  for  several  initial 
conditions  on  the  unit  hemisphere  to  the  right  of  the  x-z 
plane . 

Tne  roots  obtained  from  these  optimum  characteristic 
equations  conglomerate  in  limited  regions  on  the  s-plane. 
These  regions  are  shown  in  Figure  15.   Observe  that  the 
problem  of  stability  has  been   automatically  solved.   If  tne 
constraint  oc±   the  actual  system  were  released  these  opti- 
mum regions  would  collapse  into  points  where  the  aodel  poles 
are  and  the  cost  function  would  be  identically  zero  for  all 
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initial  conditions. 

Each  set  of  optimum  poles  is  associated  with  a  value 
of  the  cost  function,  which  is  a  minimum  for  the  initial 
state  from  which  this  set  was  obtained.   For  any  other 
initial  state  there  will  be  a  different  set  of  optimum 
parameters.   The  final  selection  of  parameters  is  based  on 
the  statistical  characteristics  of  the  disturbance.   The 
modified  index  is  obtained  from  an  extension  of  equation 
(31)  to  a  three-dimensional  space.   For  a  uniform  proba- 
bility distribution  over  the  hemisphere  this  index  is 

=  £:(fy+  Fta  +  *fc»)  4-  |fii  (39) 

This  modified  index  is  independent  of  the  initial 
state.   The  minimum  average  cost  function,  and  hence  the 
minimax  solution  is  obtained  for  this  example  with  the 
optimum  coefficients 


al  =  6'5 
a?  =  8.7 


The  corresponding  poles  are  shown  in  Figure  15. 

A  reasonable  choice  is  to  assume  an  initial  state 
vector 


xT(0)  =(10  0) 


The  optimum  set  of  poles  for  this  case  is  shown  in  Figure 
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15.   Tiie  cost  subsurface  is  shown  in  Figure  16.   This  set 
of  initial  conditions  resembles  the  widely  used  step 
function  in  control  systems  design. 

A,  worthwhile  observation  is  that  the  available  free- 
dom in  the  system  parameters  could  be  used  to  reproduce 
exactly  some  of  the  corresponding  model  coefficients.   Con- 
sider the  actual  system  and  model  differential  equations 
as  given  in  equations  (3^)  and  (35) 

x  +  2x  +  ax  +  a.x  =0  (3^) 

y  +  7.8y  +  I8y  +  20y  =  0  (35) 

The  direct  reproduction  of  the  model  coefficients  in  the 
actual  system  will  yield 

x  +  2x  +  I8x  +  20x  =0  (40) 

The  corresponding  poles  are  close  to  the  optimum  regions 
obtained  by  the  previous  method.   They  are  shown  in  Figure 
15.   This  possibility  in  parameter  selection  is  limited  by 
the  stability  requirements  a  >0,  a2  >  0 ,  a.a^-an  >0.   When- 
ever possible,  this  criterion  gives  a  good,  time-saving 
procedure  if  the  third  requirement  for  stability  is  well 
met. 

It  is  interesting  to  see  how  the  optimum  poles  migx'ate 
as  the  initial  state  vector  sweeps  the  normalized  state 
space.   A  mapping  of  a  unit  circle  on  the  x. -x?  plane  in 
the  state  space  onto  the  s-plane  is  shown  in  Figure  17  for 
this  example.   The  optimum  poles  return  to  the  saiae  point 
after  the  initial  conditions  vector  turns  100°. 
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Pig.  16.  Isometric  projection  of  cost  subsurface.  Model 

and  actual  system  as  in  Figure  14*   Initial  state 
vector  xT(0)  =  (1   0  0) 
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Consider  now  that  for  tne  same  performance  specifica- 
tions, the  constraint  on  the  actual  system  is  somewhat  less 
stringent.   Assume  that  the  system's  cnaracteristic  equation 
is 

s-^  +  6s2  +  a2s  +  a3  =  0  (41) 

The  model  poles  will  now  be  closer  to  the  attainable 
regions  of  the  given  system  and  consequently,  the  results  of 
the  optimization  procedure  will  be  included  in  smaller  re- 
gions.  These  regions  are  shown  in  Figure  18.   There  is  also 
a  net  displacement  of  these  regions  to  the  left  and  now  the 
complex  conjugate  model  poles  are  included.   The  set  of 
poles  obtained  by  trie  mere  duplication  of  model  coefficients 
in  tne  free  terms  is  also  shown. 

Using  the  modified  index  of  equation  (39)  for  a  uniform 
probability  on  the  initial  state,  the  final  selection  is 

a  =  16. 3 
a2  =  15.2 

The  optimum  poles  are  shown  in  Figure  18. 


46 


model 


-5 


i 


I       t 


--  ,52 


-  J1 


-> 


-3 


-2 


— f 

t1 


O  Optimum  poles  for 
modified  index 

X  Poles  by  direct  re- 
production of  model  ' 
coefficients  in  sys- 
tem parameters 


-Hi 


-■32 


-H3 


Fig,  18.   Optimum  pole  regions  for  third  order  system 
with  constraint  in  a-j  =  6 
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CHAPTER  IV 
EVALUATION  OF  RESULTS 

Because  of  the  constraints  on  the  actual  system  and 
the  requirements  for  stability,  the  poles  of  the  system 
transfer  function  are  restricted  to  certain  regions  on  the 
s-plane.   The  optimum  pole  regions  have  a  size,  shape,  and 
position  according  to  the  proximity  of  the  model  poles  to 
the  allowable  regions.   The  selection  of  system  parameters 
for  optimum  design  was  based  on  the  statistical  properties 
of  the  disturbing  initial  conditions.   That  set  of  poles 
from  the  optimum  regions  which  gives  the  minimum  average 
index  under  all  possible  initial  conditions  is  the  desired 
solution  to  the  problem. 

The  index  of  performance  developed  in  Chapter  II  was 
given  the  form  of  equation  (1)  for  mathematical  convenience. 
The  two  indices  differ  in  the  description  of  the  weighting 
matrix.   However,  the  optimum  rjarameters  obtained  are 
identical  for  every  initial  state.   The  elements  of  the  3 
matrix  in  equation  (1)  were  chosen  to  place  the  absolute 
minimum  of  the  cost  function  at  the  coordinates  of  the 

n  i 

coefficients  of  the  model  characteristic  equation^-  -  while 
the  elements  of  the  B  matrix  in  equation  (17)  came  directly 
from  the  general  expression  of  the  performance  index  of 
equation  (12)  '^hen   expressed  in  matrix  form  for  mathematical 
manipulation. 

A  comparison  between  the  two  indices  is  done  for  the 

n  1 

second  order  system.   Tie  weighting  matrices,  4L  "-'  and  B, 
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The  expanded  form  of  the  cost  function  given  in  equation 
(2)  is,  by  use  of  equation  (22) 


^     1 


a 


*±& 


ai 


i 


J"  =  X.}{0)   — =-  j a 1-  * jl 


+  Zoqtoac^o) 


1  +  a, 


2%    2# 


+  X£(0) 


JL 


[*% 


a  a, 


#a* 


+ 


2*2- 


ai 


<#  +  JUiO*.  +  2^0*  _ 


Similarly 


ikk) 


Jft  =  xf(o) 


B 


2% 


+ 


-5l.  _  JbSS  +  JBl 

20g,     Qz,    2a, 


2a 


L  J 


+-  ZX^X^o) 


Oj 


i  + 


Jl 

10,1 


+  xa(o) 


Q±_  _   _fc 


Zdi 


Ol-l 


-f- 


J£ 


^o4a^  _ 


(^5) 


where  J  =  index  of  performance  with  matrix  3 

J  =  index  of  performance  with  matrix  B 
B 


k9 


Equations  (44)  and  (45)  are  related  by 

Sl2jQ  "  JB  =  Xl  (0)S3£2  +  2x1(°)x2(°)£1  *  X22(0)S2     (46) 

For  any  given  initial  conditions,  the  right  hand  side  of 
equation  (46)  is  a  constant  related  to  the  model  coeffic- 
ients and  the  particular  set  of  initial  conditions.   Thus, 
in  general,  both  cost  functions  differ  by  a  constant  factor, 
which  is  the  square  of  the  model  coefficient  g  ,  and  an 
additive  constant  given  by  equation  (46).   As  a  conse- 
quence, the  optimum  coefficients  of  the  actual  system 
obtained  by  the  minimization  of  these  two  indices  are 
identical.   This  is  true  for  systems  of  any  order.   How- 
ever, the  algorithm  to  determine  the  B  matrix  is  simpler 
than  that  for  the  Q  matrix. 
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